Neural signals encoding shifts in beliefs

Dopamine is implicated in a diverse range of cognitive functions including cognitive flexibility, task switching, signalling novel or unexpected stimuli as well as advance information. There is also longstanding line of thought that links dopamine with belief formation and, crucially, aberrant belief formation in psychosis. Integrating these strands of evidence would suggest that dopamine plays a central role in belief updating and more specifically in encoding of meaningful information content in observations. The precise nature of this relationship has remained unclear. To directly address this question we developed a paradigm that allowed us to decompose two distinct types of information content, information-theoretic surprise that reflects the unexpectedness of an observation, and epistemic value that induces shifts in beliefs or, more formally, Bayesian surprise. Using functional magnetic-resonance imaging in humans we show that dopamine-rich midbrain regions encode shifts in beliefs whereas surprise is encoded in prefrontal regions, including the pre-supplementary motor area and dorsal cingulate cortex. By linking putative dopaminergic activity to belief updating these data provide a link to false belief formation that characterises hyperdopaminergic states associated with idiopathic and drug induced psychosis

The Dopaminergic Midbrain Encodes the Expected Certainty about Desired Outcomes

Dopamine plays a key role in learning; however, its exact function in decision making and choice remains unclear. Recently, we proposed a generic model based on active (Bayesian) inference wherein dopamine encodes the precision of beliefs about optimal policies. Put simply, dopamine discharges reflect the confidence that a chosen policy will lead to desired outcomes. We designed a novel task to test this hypothesis, where subjects played a "limited offer" game in a functional magnetic resonance imaging experiment. Subjects had to decide how long to wait for a high offer before accepting a low offer, with the risk of losing everything if they waited too long. Bayesian model comparison showed that behavior strongly supported active inference, based on surprise minimization, over classical utility maximization schemes. Furthermore, midbrain activity, encompassing dopamine projection neurons, was accurately predicted by trial-by-trial variations in model-based estimates of precision. Our findings demonstrate that human subjects infer both optimal policies and the precision of those inferences, and thus support the notion that humans perform hierarchical probabilistic Bayesian inference. In other words, subjects have to infer both what they should do as well as how confident they are in their choices, where confidence may be encoded by dopaminergic firing

Active inference, evidence accumulation, and the urn task

Deciding how much evidence to accumulate before making a decision is a problem we and other animals often face, but one that is not completely understood. This issue is particularly important because a tendency to sample less information (often known as reflection impulsivity) is a feature in several psychopathologies, such as psychosis. A formal understanding of information sampling may therefore clarify the computational anatomy of psychopathology. In this theoretical letter, we consider evidence accumulation in terms of active (Bayesian) inference using a generic model of Markov decision processes. Here, agents are equipped with beliefs about their own behavior--in this case, that they will make informed decisions. Normative decision making is then modeled using variational Bayes to minimize surprise about choice outcomes. Under this scheme, different facets of belief updating map naturally onto the functional anatomy of the brain (at least at a heuristic level). Of particular interest is the key role played by the expected precision of beliefs about control, which we have previously suggested may be encoded by dopaminergic neurons in the midbrain. We show that manipulating expected precision strongly affects how much information an agent characteristically samples, and thus provides a possible link between impulsivity and dopaminergic dysfunction. Our study therefore represents a step toward understanding evidence accumulation in terms of neurobiologically plausible Bayesian inference and may cast light on why this process is disordered in psychopathology

Hyperspectral Imaging as an Early Biomarker for Radiation Exposure and Microcirculatory Damage

BACKGROUND: Radiation exposure can lead to detrimental effects in skin microcirculation. The precise relationship between radiation dose received and its effect on cutaneous perfusion still remains controversial. Previously, we have shown that hyperspectral imaging (HSI) is able to demonstrate long-term reductions in cutaneous perfusion secondary to chronic microvascular injury. This study characterizes the changes in skin microcirculation in response to varying doses of ionizing radiation and investigates these microcirculatory changes as a possible early non-invasive biomarker that may correlate with the extent of long-term microvascular damage.METHODS: Immunocompetent hairless mice (n=66) were exposed to single fractions of superficial beta-irradiation in doses of 0, 5, 10, 20, 35, or 50 Gy. A HSI device was utilized to measure deoxygenated hemoglobin levels in irradiated and control areas. HSI measurements were performed at baseline before radiation exposure and for the first three days post-irradiation. Maximum macroscopic skin reactions were graded, and histological assessment of cutaneous microvascular densities at four weeks post-irradiation was performed in harvested tissue by CD31 immunohistochemistry.RESULTS: CD31 immunohistochemistry demonstrated a significant correlation (r=0.90, p<0.0001) between dose and vessel density reduction at four weeks. Using HSI analysis, early changes in deoxygenated hemoglobin levels were observed during the first three days post-irradiation in all groups. These deoxygenated hemoglobin changes varied proportionally with dose (r=0.98, p<0.0001) and skin reactions (r=0.98, p<0.0001). There was a highly significant correlation (r= 0.91, p<0.0001) between these early changes in deoxygenated hemoglobin and late vascular injury severity assessed at the end of four weeks.CONCLUSIONS: Radiation dose is directly correlated with cutaneous microvascular injury severity at four weeks in our model. Early post-exposure measurement of cutaneous deoxygenated hemoglobin levels may be a useful biomarker for radiation dose reconstruction and predictor for chronic microvascular injury

Examples of the Zeroth Theorem of the History of Physics

The zeroth theorem of the history of science (enunciated by E. P. Fischer) and widely known in the mathematics community as Arnol'd's Principle (decreed by M. V. Berry), states that a discovery (rule, regularity, insight) named after someone (often) did not originate with that person. I present five examples from physics: the Lorentz condition defining the Lorentz gauge of the electromagnetic potentials; the Dirac delta function (x); the Schumann resonances of the earth-ionosphere cavity; the Weizsacker-Williams method of virtual quanta; the BMT equation of spin dynamics. I give illustrated thumbnail sketches of both the true and reputed discoverers and quote from their "discovery" publications.Comment: 36 pages, 8 figures. Small revisions, added material and references - Arnol'd's law, Emil Wiechert. Submitted to Am. J. Phy

Hyperspectral imaging for early detection of oxygenation and perfusion changes in irradiated skin

Studies examining acute oxygenation and perfusion changes in irradiated skin are limited. Hyperspectral imaging (HSI), a method of wide-field, diffuse reflectance spectroscopy, provides noninvasive, quantified measurements of cutaneous oxygenation and perfusion. This study examines whether HSI can assess acute changes in oxygenation and perfusion following irradiation. Skin on both flanks of nude mice (n=20) was exposed to 50 Gy of beta radiation from a strontium-90 source. Hyperspectral images were obtained before irradiation and on selected days for three weeks. Skin reaction assessment was performed concurrently with HSI. Desquamative injury formed in all irradiated areas. Skin reactions were first seen on day 7, with peak formation on day 14, and resolution beginning by day 21. HSI demonstrated increased tissue oxygenation on day 1 before cutaneous changes were observed (

Improving the sensitivity of the hop index in patients with an ACL deficient knee by transforming the hop distance scores

BACKGROUND: The one leg hop for distance is one of the most commonly employed functional tests utilized in the evaluation of the ACL deficient and reconstructed patient. While the reliability of the hop test scores has been well established, validity studies have revealed low sensitivity rates in detecting functional limitations using the hop index (the ratio or percentage of limb performance). However, the impact of the inherent limitations associated with the hop index have not been investigated to date. One specific limitation relates to the impact of the differences in the underlying hop distance scores. Therefore, this pilot study set out to determine: 1) the impact that between limb differences in hop distance has on the sensitivity of the hop index in detecting functional limitations and; 2) whether a logarithmic transformation of the underlying hop distance scores improves the sensitivity of the hop index. METHODS: A cross sectional design involving the evaluation of one leg hop for distance performance in a consecutive sample of 10 ACL deficient males with an isolated ACL tear awaiting reconstructive surgery and nine gender, age-matched controls. RESULTS: In the ACL deficient, the hop index was associated with the distance hopped on the non-injured limb (r = -0.66, p = 0.04) but not on the injured limb. Transformation (logarithmic) of the hop distance scores and re-calculation of the hop index using the transformed scores increased the sensitivity of the hop index in the detection of functional limitations from 20 to 60% and 50 to 70% using the normal limb symmetry reference norms of ≥ 85% and 90% respectively. CONCLUSION: The distance hopped on the non-injured limb is a critical factor in detecting functional limitations using the hop index in patients with an ACL deficient knee. Logarithmic transformation of the hop distance scores minimizes the effect of the arithmetic differences between limbs however; the sensitivity of the hop index in detecting abnormal limb symmetry remains low

Active Inference: A Process Theory

This article describes a process theory based on active inference and belief propagation. Starting from the premise that all neuronal processing (and action selection) can be explained by maximizing Bayesian model evidence—or minimizing variational free energy—we ask whether neuronal responses can be described as a gradient descent on variational free energy. Using a standard (Markov decision process) generative model, we derive the neuronal dynamics implicit in this description and reproduce a remarkable range of well-characterized neuronal phenomena. These include repetition suppression, mismatch negativity, violation responses, place-cell activity, phase precession, theta sequences, theta-gamma coupling, evidence accumulation, race-to-bound dynamics, and transfer of dopamine responses. Furthermore, the (approximately Bayes’ optimal) behavior prescribed by these dynamics has a degree of face validity, providing a formal explanation for reward seeking, context learning, and epistemic foraging. Technically, the fact that a gradient descent appears to be a valid description of neuronal activity means that variational free energy is a Lyapunov function for neuronal dynamics, which therefore conform to Hamilton’s principle of least action